Imaging apparatus and imaging method

ABSTRACT

An imaging apparatus of an embodiment includes a captured video signal outputting unit, a data outputting unit, a supplement processing unit, and a video processing unit. The captured video signal outputting unit outputs a captured video signal related to video captured using an image capturing element. The data outputting unit outputs part of data related to the image capturing elements stored in a storage unit. The supplement processing unit receives the outputted part of the data related to the image capturing elements and uses the received part of the data related to the image capturing elements to perform supplement processing of the data. The video processing unit performs video processing of the outputted captured video signal using the supplement processed data and outputs a video signal.

CROSS-REFERENCE TO RELATED APPLICATION

This application is based upon and claims the benefit of priority fromthe prior Japanese Patent Application No. 2011-109915, filed on May 16,2011; the entire contents of which are incorporated herein by reference.

FIELD

Embodiments described herein related generally to an imaging apparatusand an imaging method.

BACKGROUND

In recent years, imaging apparatuses which perform image capturing usingan image sensor such as a CCD image sensor (Charge

Coupled Device Image Sensor) or a CMOS image sensor (Complementary MetalOxide Semiconductor Image Sensor) are in widespread use.

In an image sensor, a large number, several hundred or more for example,of image capturing elements (pixels) are used, and these image capturingelements (pixels) each have fixed pattern noise. As an example of thefixed pattern noise, there is dark current shading or the like forexample.

It is possible that data related to the fixed pattern noise are measuredin advance and stored in a camera head or the like, and when the imagingapparatus is activated, for example, they are read and sent to a CCU(Camera Control Unit) or the like to be used for video processing of acaptured video signal or the like.

However, as described above, the image sensor has a large number ofimage capturing elements (pixels) which each have fixed pattern noise,and thus it has been time consuming to transmit the fixed pattern noiseto the CCU or the like. That is, in an imaging apparatus such as anendoscope, the amount of data related to noise data or the like of imagecapturing elements stored in a head unit has become large. Accordingly,a transmitting time for sending these data to a control unit such as theCCU becomes long, and it will take much time to output video on whichthe noise data of the image capturing elements are reflected.

Thus, it is possible that, for example, a time of about ten seconds istaken from turning on the power of the imaging apparatus untiloutputting video on which data related to the fixed pattern noise of theabove-described image sensor are reflected.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagram illustrating an example of the structure of animaging apparatus according to an embodiment.

FIG. 2A and FIG. 2B are diagrams illustrating examples of arrays ofcolor filters used for the imaging apparatus according to theembodiment.

FIG. 3 is a diagram illustrating an example of data related to the imagecapturing elements in the imaging apparatus according to the embodiment.

FIG. 4 is a diagram illustrating an example of fixed pattern noise dataof all the pixels of an image sensor in the imaging apparatus accordingto the embodiment.

FIG. 5A and FIG. 5B are diagrams illustrating an example of the fixedpattern noise data to be thinned and transmitted in the imagingapparatus according to the embodiment and an interpolation example ofthe noise data.

FIG. 6A and FIG. 6B are diagrams illustrating other examples of thefixed pattern noise data to be thinned and transmitted in the imagingapparatus according to the embodiment and interpolation of the noisedata.

FIG. 7 is a diagram illustrating another example of the fixed patternnoise data to be thinned and transmitted in the imaging apparatusaccording to the embodiment.

FIG. 8A to FIG. 8D are diagrams illustrating other examples of the fixedpattern noise data to be thinned and transmitted in the imagingapparatus according to the embodiment.

FIG. 9A to FIG. 9D are diagrams illustrating other examples of the fixedpattern noise data to be thinned and transmitted in the imagingapparatus according to the embodiment.

FIG. 10A to FIG. 10D are diagrams illustrating other examples of thefixed pattern noise data to be thinned and transmitted in the imagingapparatus according to the embodiment.

FIG. 11A and 11B are flowcharts describing operation of the imagingapparatus according to the embodiment.

DETAILED DESCRIPTION

An imaging apparatus of an embodiment includes a captured video signaloutputting unit, a data outputting unit, a supplement processing unit,and a video processing unit. The captured video signal outputting unitoutputs a captured video signal related to video captured using an imagecapturing element. The data outputting unit outputs part of data relatedto the image capturing elements stored in a storage unit. The supplementprocessing unit receives the outputted part of the data related to theimage capturing elements and uses the received part of the data relatedto the image capturing elements to perform supplement processing of thedata. The video processing unit performs video processing of theoutputted captured video signal using the supplement processed data andoutputs a video signal.

Hereinafter, an embodiment will be described with reference to thedrawings. In this embodiment, a structure will be described using a headdetachable endoscope as an example of an imaging apparatus.

In an imaging apparatus (solid-state imaging camera) using a solid-stateimage capturing element such as a CCD sensor, a CMOS sensor, or the likefor an image capturing unit (image sensor), deterioration in picturequality easily occurs due to fixed pattern noise which a solid-stateimage capturing element has.

Further, as the fixed pattern noise, there are one independent of anincident light amount on the solid-state image capturing element, andone dependent on the incident light amount on the solid-state imagecapturing element. Then, the fixed pattern noise independent of theincident light amount on the solid-state image capturing element can bedetected in a light-shielded state for example. However, for the fixedpattern noise dependent on the incident light amount, it is necessary toadjust a detection environment.

Here, an example of a detecting method of the fixed pattern noisedependent on the incident light amount will be described. In the fixedpattern noise, basically there is no change due to position or time.From this fact, for example, the fixed pattern noise dependent on theincident light amount can be detected as described in the following (1)and (2). That is to say, (1) a subject for which the output of the idealsolid-state image capturing element is known is captured with an actualsolid-state image capturing element, and outputs from this solid-stateimage capturing element are averaged in a time direction to removerandom noise. (2) The difference between the output obtained as a resultof this and the output of the ideal solid-state image capturing elementis taken.

More specifically, for example, the fixed pattern noise dependent on theincident light amount can be detected as described in the following (1)and (2). That is to say, (1) a subject with a uniform light amount isphotographed, and random noise is removed by passing through a LPF(low-pass filter) in a time direction. (2) Thereafter, the average valueof the entire imaging screen or of a partial area thereof is calculated,and the difference therebetween is taken.

Further, whether to use the average value of the entire imaging screenor the average value of a partial area can be selected depending on, forexample, the shading amount and the random noise amount of an opticalsystem, and desired detection sensitivity of fixed pattern noise.

Further, for example, when the average value of the entire imagingscreen is used, it is advantageous in view of random noise, but shadingin the optical system is easily detected as an error. Conversely, whenthe average value of the partial area of the imaging screen is used, itis possible to cancel the shading in the optical system. However, theeffect of removing random noise decreases, and remaining noise can beeasily detected as an error.

Therefore, in detection of the fixed pattern noise dependent on theincident light amount, for example, to improve detection accuracy, it isimportant to select an optical system with as less shading as possibleand take a wide area for calculating the average value.

As described above, for the fixed pattern noise dependent on theincident light amount, it is necessary to adjust a detection environmentas described above. For example, it is not desirable that automaticdetection is performed or the user is required to perform detectionevery time the power of the imaging apparatus is turned on. Accordingly,it is desired to perform detection of the fixed pattern noise and storethe detected noise in, for example, the main body of the imagingapparatus in advance at the time of shipping of the product of theimaging apparatus or the like.

Further, in the head-detachable camera for example, since the fixedpattern noise data are information inherent to a camera head 20, it isdesired to store them in a non-volatile storage medium in the camerahead 20.

However, the data reading speed from the non-volatile storage medium(memory) is not fast. Accordingly, in general, when the power of theimaging apparatus is turned on for example, data are transferred once tothe non-volatile memory such as an SDRAM, and a correction circuitperforms a correcting operation using the data stored in the SDRAM.

Accordingly, for example, it is not possible to perform correction ofthe fixed pattern noise in the period until completion of the transferprocessing of the fixed pattern noise from the storage area in thecamera head 20 to the memory (SDRAM or the like) for the correctioncircuit.

Consequently, as described above, there is a possibility that a problemof elongation of data transfer time arises due to increase in fixedpattern noise data amount accompanying increase in pixels of the imagesensor.

FIG. 1 is a diagram illustrating an example of the structure of animaging apparatus according to an embodiment. Numeral 1 denotes animaging apparatus, numeral 10 a denotes a lens, numeral 10 denotes ascope, numeral 20 denotes a camera head, numeral 21 denotes an imagesensor (image capturing unit), numeral 22 denotes a storage unit (flashmemory), numeral 30 denotes a CCU, numeral 31 denotes a signalprocessing unit, numeral 32 denotes a storage unit (SDRAM), numeral 33denotes a CPU, numeral 40 denotes a light source, numeral 50 denotes acamera cable, numeral 60 denotes an optical fiber, numeral 70 denotes asignal cable, and numeral 80 denotes a video display device (LCD).

Here, the imaging apparatus (endoscope) 1 is provided with, for example,the objective lens 10 a at a distal end thereof. Further, there aredisposed the scope 10 to be inserted into a subject to be inspected andthe image sensor 21 (image capturing unit) provided in the camera head20 on an imaging plane of the objective lens 10 a.

Then, a captured video signal captured in this image sensor 21 (imagecapturing unit) is outputted to the CCU 30 via the camera cable 50.

Further, the camera head 20 is provided with the storage unit (flashmemory) 22 storing data of fixed pattern noise related to respectiveimage capturing elements of the image sensor 21 (image capturing unit).

In this embodiment, for example, when the power of the imaging apparatus1 is turned on first, the camera head 20 performs spatial thinningprocessing of data of fixed pattern noise (fixed pattern noise data ofall the pixels) related to the respective image capturing elements ofthe image sensor 21 (image capturing unit) stored in the storage unit(flash memory) 22, and outputs the result to the CCU 30 (thinned data).The CCU 30 receives the thinned data. The thinning processing means, forexample, to extract fixed pattern noise data of part of pixels from thefixed pattern noise data of all the pixels (one kind of sampling). Atthis time, regular thinning (sampling) facilitates interpolationprocessing in the CCU 30.

The CCU 30 performs interpolation processing using the thinned data togenerate fixed pattern data of an untransmitted part (lacking part ofthe thinned data). The generation of the fixed pattern data of theuntransmitted part can be performed while receiving the thinned data.Accordingly, when most of the receiving time of the thinned data passes,it becomes possible to output video on which noise data of the imagecapturing elements are reflected.

Thus, if the transmission time of the thinned data is 4.5 seconds whentransmission of all the data of fixed pattern noise stored in thestorage unit (flash memory) 22 takes about 9 seconds, it becomespossible to reduce the time taken for outputting video on which noisedata of the image capturing elements are reflected to about 4.5 seconds,which is about half (½).

Further, in parallel with the interpolation processing, the camera head20 outputs the fixed pattern data of the untransmitted part (lackingpart of the spatially thinned data) stored in the storage unit (flashmemory) 22 to the CCU 30. The CCU 30 receives the fixed pattern data ofthe untransmitted part (lacking part of the spatially thinned data)outputted from the camera head 20.

Next, the CCU 30 replaces the data generated by the interpolationprocessing with the fixed pattern data of the untransmitted part(lacking part of the spatially thinned data), thereby obtaining thefixed pattern noise data of all the pixels. Then, in this embodiment,the CCU 30 uses the obtained fixed pattern noise data of all the pixelsto perform video processing of a video signal.

In other words, in this embodiment, for example, part of data related tothe image capturing elements (data of fixed pattern noise related to therespective image capturing elements of the image sensor 21) stored inthe storage unit (flash memory) 22 is outputted to the CCU 30. The CCU30 receives the captured video signal outputted from the camera head 20.

Further, the CCU 30 receives the part of the data related to the imagecapturing elements outputted from the camera head 20, and uses thisreceived part of the data related to the image capturing elements toperform supplement processing of the data (which will be describedlater). The contents of these processes are controlled by the CPU 33,and stored in the storage unit (SDRAM) for example.

Further, the CCU 30 performs video processing of the captured videosignal outputted from the camera head 20 using the supplement processeddata related to the image capturing elements, and outputs a videosignal. These processes are controlled by the CPU 33. The video displayunit (LCD) 80 receives the video signal outputted from the CCU 30, anddisplays and outputs video.

Further, this imaging apparatus 1 includes the light source 40 whichexposes the range of performing the above-described image capturing tolight and the optical fiber 60 which introduces light outputted fromthis light source 40 to a distal end part of the scope 10.

Further, the camera cable 50 has, for example, signal lines fortransmitting/receiving a captured video signal and a control signalbetween the camera head 20 and the CCU 30, a power line for supplyingpower from the CCU 30 to the camera head 20, and the like.

Further, the above-described image sensor 21 may be structured of whatis called a three-plate type or a single-plate type. For example, in animage sensor of the single-plate type, color filters are provided aboverespective pixels of the image sensor (CMOS sensor), and for example, anelectric signal outputted from the image sensor (CMOS sensor) is colorseparated into R, G, B signals in a predetermined circuit. In thesingle-plate type image sensor, it is not necessary to bond a prism (notillustrated) and the image sensor (CMOS sensor), and thus it can beproduced inexpensively.

FIG. 2A and FIG. 2B are diagrams illustrating examples of arrays ofcolor filters used for the imaging apparatus according to theembodiment. There are various methods for arrays of color filters, andexamples of such methods will be described here.

FIG. 2A is an example of color filters in a color difference linesequential array. In the color difference line sequential array, colorfilters of M(R+B), Y(G+B), C(R+G) called a complementary color and acolor filter of G are arranged in the array illustrated in FIG. 2A. Inthe color difference line sequential array, two primary colors (R+G,G+B, R+G) are obtained in one pixel for example, by using thecomplementary colors M, Y, C.

Incidentally, for example, the color difference line sequential array ispreferable for an image sensor driven by interlaced scanning.

FIG. 2B is an example of a color filter in a Bayer array. In this Bayerarray, color filters of primary colors (R, G, B) are arranged so thatthe color filters of G are double the color filters of R and B. This isbecause human eyes are sensitive to green light. Thus, it is possible toincrease the resolution of captured video.

Incidentally, the image sensor 21 of the imaging apparatus (endoscopeapparatus) 1 according to this embodiment may employ color filters in adifferent array.

FIG. 3 is a diagram illustrating an example of data related to the imagecapturing elements in the imaging apparatus according to the embodiment.

In this embodiment, base noise whose level (intensity) does not changedue to external environment, such as temperature and luminance forexample, are corrected. Accordingly, for example, the base noise of theCMOS sensor which the image sensor 21 has is measured in each pixel inadvance, and correction data to cancel this base noise as illustrated inFIG. 3 are made to correspond to the pixels and stored in, for example,the flash memory 22. Then, the correction data stored in the flashmemory 22 are added to the captured video signal outputted from theimage sensor 21. Thus the video signal is corrected.

Incidentally, it is also possible to measure the base noise byinstructing the CMOS sensor to output a predetermined voltage (referencevoltage) and checking deviation of the actually outputted voltage fromthe reference voltage in each pixel.

FIG. 4 is a diagram illustrating an example of the fixed pattern noisedata of all the pixels of the image sensor in the imaging apparatusaccording to the embodiment. Here, the fixed pattern noise data of allthe pixels of the image sensor 21 which are detected in advance areillustrated.

The fixed pattern noise data of all the pixels of the image sensor 21 tobe transmitted to the CCU 30 are stored in, for example, the flashmemory 22. As illustrated in FIG. 4, for pixels to which “D” is added,the fixed pattern noise data are detected in advance.

FIG. 5A and FIG. 5B are diagrams illustrating an example of the fixedpattern noise data to be thinned and transmitted in the imagingapparatus according to the embodiment and an interpolation example ofthe noise data.

FIG. 5A is a transmission example 1 of the fixed pattern noise datawhich are thinned and transmitted from the camera head 20 to the CCU 30.Here, the thinning processing (sampling processing) is performed firston every other line (row), and the amount of thinned data that is halfthe whole amount is transmitted.

In this embodiment, the camera head 20 first transmits part of the wholefixed pattern noise data, specifically half the amount of the wholedata, stored in the flash memory 22 as thinned data to the CCU 30.

FIG. 5B is an interpolation example of the fixed pattern noise data inthe CCU 30.

The CCU 30 receives the above-described thinned data and stores them inthe SDRAM 32. Further, the CCU 30 is controlled by the CPU 33 to receivethe thinned data and meanwhile perform supplement processing using thethinned data, thereby creating supplement data for the fixed patternnoise data of the image sensor 21 which are needed for video processingthe video signal. The supplement data are stored in, for example, theSDRAM 32 for supplementing a lacking part of the thinned data.

This supplement processing is performed as follows for example.Specifically, as illustrated in FIG. 5B, a supplement data row 55 a iscreated from the first line (row) and the third line (row) of thethinned data.

Similarly, a supplement data row 55 b is created from the third line(row) and the fifth line (row) of the thinned data. Further, similarly,a supplement data row 55 c is created from the fifth line (row) and theseventh line (row) of the thinned data. Further, similarly, a supplementdata row 55 d is created from the seventh line (row) and the ninth line(row) of the thinned data, thereby creating the supplement data of thefixed pattern noise data of the image sensor 21.

Further, although the supplement data are created from the two lines(rows) before and after a line (row) lacking data in the abovedescription, it is possible to create the supplement data using, forexample, the data of the line (row) located before the line (row)lacking data without changing them.

By this supplement processing, the fixed pattern noise data(supplemented version) of all the pixels of the image sensor 21 arestored in the SDRAM 32. Then, the video signal is video processed usingthe fixed pattern noise data (supplemented version) of all the pixels ofthe image sensor 21, so as to output video.

FIG. 6A and FIG. 6B are diagrams illustrating other examples of thefixed pattern noise data to be thinned and transmitted in the imagingapparatus according to the embodiment and interpolation of the noisedata.

Here, first there is transmitted the amount of thinned data, which ishalf the amount of the whole data, resulting from performing thinningprocessing on every other pixel (one line (one column)) as illustratedin FIG. 6A. That is, also in this embodiment, the camera head 20 firsttransmits part of the whole fixed pattern noise data, specifically halfthe amount of the whole data, stored in the flash memory 22 as thinneddata to the CCU 30.

FIG. 6B is an interpolation example of the fixed pattern noise data inthe CCU 30.

The CCU 30 receives the above-described thinned data and stores them inthe SDRAM 32. Further, the CCU 30 is controlled by the CPU 33 to receivethe thinned data and meanwhile perform supplement processing using thethinned data, thereby creating supplement data for the fixed patternnoise data of the image sensor 21 which are needed for video processingthe video signal. The supplement data are stored in, for example, theSDRAM 32 for supplementing a lacking part of the thinned data.

This supplement processing is performed as follows for example.Specifically, as illustrated in FIG. 6B, a supplement data column 65 ais created from the first line (column) and the third line (column) ofthe thinned data. Similarly, a supplement data column 65 b is createdfrom the third line (column) and the fifth line (column) of the thinneddata. Further, similarly, a supplement data column 65 c is created fromthe fifth line (column) and the seventh line (column) of the thinneddata. Further, similarly, a supplement data column 65 d is created fromthe seventh line (column) and the ninth line (column) of the thinneddata, thereby creating the supplement data of the fixed pattern noisedata of the image sensor 21. Further, similarly, a supplement datacolumn 65 f is created from the ninth line (column) and the eleventhline (column) of the thinned data, thereby creating the supplement dataof the fixed pattern noise data of the image sensor 21.

Further, although the supplement data are created from the two lines(columns) before and after a line (column) lacking data in the abovedescription, it is possible to create the supplement data using, forexample, the data of the line (column) located before the line (column)lacking data without changing them.

By this supplement processing, the fixed pattern noise data(supplemented version) of all the pixels of the image sensor 21 arestored in the SDRAM 32. Then, the video signal is video processed usingthe fixed pattern noise data (supplemented version) of all the pixels ofthe image sensor 21, so as to output video.

FIG. 7 is a diagram illustrating another example of the fixed patternnoise data to be thinned and transmitted in the imaging apparatusaccording to the embodiment.

Here, first there is transmitted the amount of thinned data, which ishalf the amount of the whole data, resulting from performing thinningprocessing on every other pixel in a checker form as illustrated in FIG.7.

In this embodiment, the camera head 20 first transmits part of the wholefixed pattern noise data, specifically half the amount of the whole dataresulting from performing thinning processing on every other pixel in achecker form, stored in the flash memory 22 as thinned data to the CCU30.

Similarly to the above description, the CCU 30 receives theabove-described thinned data and stores them in the SDRAM 32. Further,the CCU 30 is controlled by the CPU 33 to receive the thinned data andmeanwhile perform supplement processing using the thinned data, therebycreating supplement data for the fixed pattern noise data of the imagesensor 21 which are needed for video processing the video signal.

FIG. 8A to FIG. 8D are diagrams illustrating other examples of the fixedpattern noise data to be thinned and transmitted in the imagingapparatus according to the embodiment.

FIG. 8A is a transmission example of the fixed pattern noise data whichare thinned and transmitted first from the camera head 20 to the CCU 30.Here, first, thinned data resulting from performing thinning processingto the amount of a ¼ line are transmitted. The symbol “1” means thethinned data to be transmitted first.

The camera head 20 transmits part of the whole fixed pattern noise data,specifically the amount of ¼ of the whole data of the symbol “1”, storedin the flash memory 22 as thinned data to the CCU 30.

FIG. 8B is a transmission example of the fixed pattern noise data whichare thinned and transmitted second from the camera head 20 to the CCU30. Also here, first, thinned data of the next ¼ line are transmitted.The symbol “2” means the thinned data to be transmitted second.

The camera head 20 transmits part of the whole fixed pattern noise data,specifically the amount of ¼ of the whole data of the symbol “2”, storedin the flash memory 22 as thinned data to the CCU 30.

FIG. 8C is a transmission example of the fixed pattern noise data whichare thinned and transmitted third from the camera head 20 to the CCU 30.Also here, thinned data of the next ¼ line are transmitted. The symbol“3” means the thinned data to be transmitted third.

The camera head 20 transmits part of the whole fixed pattern noise data,specifically the amount of ¼ of the whole data of the symbol “3”, storedin the flash memory 22 as thinned data to the CCU 30.

FIG. 8D is a transmission example of the fixed pattern noise data whichare thinned and transmitted fourth from the camera head 20 to the CCU30. Also here, thinned data of the next ¼ line are transmitted. Thesymbol “4” means the thinned data to be transmitted fourth.

The camera head 20 transmits part of the whole fixed pattern noise data,specifically the amount of remaining ¼ of the data of the symbol “4”,stored in the flash memory 22 as thinned data to the CCU 30. Thus, thefixed pattern noise data of all the pixels are transmitted.

Similarly to the above description, the CCU 30 receives theabove-described thinned data and stores them in the SDRAM 32. Further,the CCU 30 is controlled by the CPU 33 to receive the thinned data andmeanwhile appropriately perform supplement processing using the thinneddata, thereby creating supplement data for the fixed pattern noise dataof the image sensor 21 which are needed for video processing the videosignal.

FIG. 9A to FIG. 9D are diagrams illustrating other examples of the fixedpattern noise data to be thinned and transmitted in the imagingapparatus according to the embodiment.

FIG. 9A is a transmission example of the fixed pattern noise data whichare thinned and transmitted first from the camera head 20 to the CCU 30.Here, first, thinned data resulting from performing thinning processingto the amount of a ¼ line (column) are transmitted. The symbol “1” meansthe thinned data to be transmitted first.

The camera head 20 transmits part of the whole fixed pattern noise data,specifically the amount of ¼ of the whole data of the symbol “1”, storedin the flash memory 22 as thinned data to the CCU 30.

FIG. 9B is a transmission example of the fixed pattern noise data whichare thinned and transmitted second from the camera head 20 to the CCU30. Also here, thinned data of the next ¼ line (column) are transmitted.The symbol “2” means the thinned data to be transmitted second.

The camera head 20 transmits part of the whole fixed pattern noise data,specifically the amount of ¼ of the whole data of the symbol “2”, storedin the flash memory 22 as thinned data to the CCU 30.

FIG. 9C is a transmission example of the fixed pattern noise data whichare thinned and transmitted third from the camera head 20 to the CCU 30.Also here, thinned data of the next ¼ line (column) are transmitted. Thesymbol “3” means the thinned data to be transmitted third.

The camera head 20 transmits part of the whole fixed pattern noise data,specifically the amount of ¼ of the whole data of the symbol “3”, storedin the flash memory 22 as thinned data to the CCU 30.

FIG. 9D is a transmission example of the fixed pattern noise data whichare thinned and transmitted fourth from the camera head 20 to the CCU30. Also here, thinned data of the next ¼ line (column) are transmitted.The symbol “4” means the thinned data to be transmitted fourth.

The camera head 20 transmits part of the whole fixed pattern noise data,specifically the amount of remaining ¼ of the data of the symbol “4”,stored in the flash memory 22 as thinned data to the CCU 30. Thus, thefixed pattern noise data of all the pixels are transmitted.

Similarly to the above description, the CCU 30 receives theabove-described thinned data and stores them in the SDRAM 32. Further,the CCU 30 is controlled by the CPU 33 to receive the thinned data andmeanwhile appropriately perform supplement processing using the thinneddata, thereby creating supplement data for the fixed pattern noise dataof the image sensor 21 which are needed for video processing the videosignal.

FIG. 10A to FIG. 10D are diagrams illustrating other examples of thefixed pattern noise data to be thinned and transmitted in the imagingapparatus according to the embodiment.

FIG. 10A is a transmission example of the fixed pattern noise data whichare thinned and transmitted first from the camera head 20 to the CCU 30.Here, first, thinned data resulting from performing thinning processingas illustrated in FIG. 10A are transmitted. The symbol “1” means thethinned data to be transmitted first.

The camera head 20 transmits part of the whole fixed pattern noise data,specifically the data of the symbol “1”, stored in the flash memory 22as thinned data to the CCU 30.

FIG. 10B is a transmission example of the fixed pattern noise data whichare thinned and transmitted second from the camera head 20 to the CCU30. Also here, thinned data as illustrated in FIG. 10B are transmitted.The symbol “2” means the thinned data to be transmitted second.

The camera head 20 transmits part of the whole fixed pattern noise data,specifically the data of the symbol “2”, stored in the flash memory 22as thinned data to the CCU 30.

FIG. 10C is a transmission example of the fixed pattern noise data whichare thinned and transmitted third from the camera head 20 to the CCU 30.Also here, thinned data as illustrated in FIG. 10C are transmitted. Thesymbol “3” means the thinned data to be transmitted third.

The camera head 20 transmits part of the whole fixed pattern noise data,specifically the data of the symbol “3”, stored in the flash memory 22as thinned data to the CCU 30.

FIG. 10D is a transmission example of the fixed pattern noise data whichare thinned and transmitted fourth from the camera head 20 to the CCU30. Also here, thinned data as illustrated in FIG. 10D are transmitted.The symbol “4” means the thinned data to be transmitted fourth.

The camera head 20 transmits part of the whole fixed pattern noise data,specifically the data of the symbol “4”, stored in the flash memory 22as thinned data to the CCU 30. Thus, the fixed pattern noise data of allthe pixels are transmitted.

Similarly to the above description, the CCU 30 receives theabove-described thinned data and stores them in the SDRAM 32. Further,the CCU 30 is controlled by the CPU 33 to receive the thinned data andmeanwhile appropriately perform supplement processing using the thinneddata, thereby creating supplement data for the fixed pattern noise dataof the image sensor 21 which are needed for video processing the videosignal.

FIG. 11A and 11B are flowcharts describing operation of the imagingapparatus according to the embodiment.

Symbol S100 denotes a starting step here. Subsequently, the processproceeds to step S101.

Step S101 is a step of turning on the power of the imaging apparatus 1.Subsequently, the process proceeds to step S102.

Step S102 is a step of starting, for example, image capturing inresponse to the turning on of the power of the imaging apparatus 1.Subsequently, the process proceeds to step S103.

Step S103 is a step of outputting a captured video signal from thecamera head 20 to the CCU 30. Subsequently, the process proceeds to stepS104.

Step S104 is a step in which the CCU 30 video processes the capturedvideo signal without using noise data of the image sensor 21 (imagecapturing elements) and outputs the result to the video display unit 80.Subsequently, the process proceeds to step S105.

Step S105 is a step of displaying and outputting in the video displayunit 80 the captured video which is video processed without using thenoise data. Subsequently, the process proceeds to step S106.

Step S106 is a step of outputting part of noise data (for example,thinned data) of the image sensor 21 (image capturing elements) storedin the flash memory 22 from the camera head 20 to the CCU 30.Subsequently, the process proceeds to step S107.

Step S107 is a step of outputting the remaining noise data of the imagesensor 21 stored in the flash memory 22 from the camera head 20 to theCCU 30. Subsequently, the process proceeds to step S108.

Step S108 is a step of receiving part of the noise data (thinned data)of the image sensor 21 and storing the data in the SDRAM 32 of the CCU30. Subsequently, the process proceeds to step S109.

Step S109 is a step of performing supplement processing using part ofthe received noise data (thinned data) and creating supplemented noisedata in which data are supplemented. Subsequently, the process proceedsto step S110.

Step S110 is a step of storing the supplemented noise data in the SDRAM32. Subsequently, the process proceeds to step S111.

Step S111 is a step of video processing the captured video signal usingthe supplemented noise data in which data are supplemented andoutputting the result to the video display unit 80. Subsequently, theprocess proceeds to step S112.

Step S112 is a step of displaying and outputting in the video displayunit 80 the captured video signal which is video processed using thesupplemented noise data. Subsequently, the process proceeds to stepS113.

Step S113 is a step in which the CCU 30 sequentially receives theremaining noise data of the image sensor 21. Subsequently, the processproceeds to step S114.

Step S114 is a step of rewriting the supplemented part of thesupplemented noise data stored in the SDRAM 32 with the remaining noisedata, and storing the noise data which are not thinned or supplementedin the SDRAM 32. Subsequently, the process proceeds to step S115.

Step S115 is a step in which the CCU 30 video processes the capturedvideo signal using the noise data which are not thinned or supplementedand outputs the result to the video display unit 80. Subsequently, theprocess proceeds to step S116.

Step S116 is a step of displaying and outputting in the video displayunit the captured video signal which is video processed using the noisedata which are not thinned or supplemented. Subsequently, the processproceeds to step S117.

Step S117 is an ending step, and the process here is finished.

Note that although the above description gives an example in which thecaptured video signal is video processed without using the noise data inthe image sensor 21 (image capturing element) in response to the turningon of the power of the imaging apparatus 1 and the result is outputtedto the video display unit 80, it is also possible to omit thisprocessing when it is desired to reflect the noise data of the imagesensor 21 (image capturing elements) for example.

In this embodiment, the imaging apparatus includes a captured videosignal outputting unit (camera head 20) outputting a captured videosignal related to video captured using an image capturing elements(image sensor 21).

Further, the imaging apparatus includes a data outputting unit (camerahead 20) outputting part of data (for example, thinned data) related tothe image capturing elements (image sensor 21) stored in a storage unit(flash memory 22).

Further, the imaging apparatus includes a supplement processing unit(CCU 30) receiving the outputted part of the data (for example, thinneddata) related to the image capturing elements and using the receivedpart of the data (for example, thinned data) related to the imagecapturing elements to perform supplement processing of the data.

Further, the imaging apparatus includes a video processing unit (CCU 30)performing video processing of the outputted captured video signal usingthe supplement processed data and outputting a video signal. The videoprocessing unit (CCU 30) uses fixed pattern data or the like related tothe image capturing elements in which the supplemented part is replacedto perform video processing of the outputted captured video signal.

With the above-described structure, the embodiment of the presentinvention allows to provide an imaging apparatus in which the time takenfor outputting video on which noise data of the image capturing elementsare reflected is reduced.

While certain embodiments have been described, these embodiments havebeen presented by way of example only, and are not intended to limit thescope of the inventions. Indeed, the novel embodiments described hereinmay be embodied in a variety of other forms; furthermore, variousomissions, substitutions and changes in the form of the embodimentsdescribed herein may be made without departing from the spirit of theinventions. The accompanying claims and their equivalents are intendedto cover such forms or modifications as would fall within the scope andspirit of the inventions.

1. An imaging apparatus, comprising: a captured video signal outputtingunit outputting a captured video signal related to video captured usingimage capturing elements; a data outputting unit outputting part of datarelated to the image capturing elements stored in a storage unit; asupplement processing unit receiving the outputted part of the datarelated to the image capturing elements and using the received part ofthe data related to the image capturing elements to perform supplementprocessing of the data; and a video processing unit performing videoprocessing of the outputted captured video signal using the supplementprocessed data and outputting a video signal.
 2. The imaging apparatusaccording to claim 1, further comprising a replacing unit receiving thedata related to the image capturing elements stored in the storage unitother than the part of the data related to the image capturing elementsand using the data other than the part of the data to replace asupplemented part of the data related to the image capturing elementswhich are supplement processed.
 3. The imaging apparatus according toclaim 2, wherein the video processing unit uses the data related to theimage capturing elements in which the supplemented part is replaced toperform video processing of the outputted captured video signal.
 4. Theimaging apparatus according to claim 1, further comprising a videodisplay unit displaying and outputting video outputted from the videoprocessing unit.
 5. The imaging apparatus according to claim 1, whereinthe data related to the image capturing elements contain data related tofixed pattern noise of the image capturing elements.
 6. The imagingapparatus according to claim 1, wherein the data related to the imagecapturing elements contain data related to a plurality of imagecapturing elements.
 7. The imaging apparatus according to claim 1,wherein part of the data related to the image capturing elements isoutputted by sampling processing.
 8. The imaging apparatus according toclaim 7, wherein the sampling processing is performed for every line ofthe image capturing elements.
 9. The imaging apparatus according toclaim 7, wherein the sampling processing is performed on every elementof the image capturing elements.
 10. The imaging apparatus according toclaim 7, wherein the sampling processing is performed in a checker formon every element of the image capturing elements.
 11. The imagingapparatus according to claim 7, wherein the sampling processing isperformed a plurality of times.
 12. An imaging method, comprising:outputting a captured video signal related to video captured using imagecapturing elements; outputting part of data related to the imagecapturing elements stored in a storage unit; receiving the outputtedpart of the data related to the image capturing elements and using thereceived part of the data related to the image capturing elements toperform supplement processing of the data; and performing videoprocessing of the outputted captured video signal using the supplementprocessed data and outputting a video signal.
 13. The imaging methodaccording to claim 12, further comprising, receiving the data related tothe image capturing elements stored in the storage unit other than thepart of the data related to the image capturing elements and using thedata other than the part of the data to replace a supplemented part ofthe data related to the image capturing elements which are supplementprocessed.
 14. The imaging method according to claim 13, wherein, in thevideo processing, the data related to the image capturing elements inwhich the supplemented part is replaced is used to perform videoprocessing of the outputted captured video signal.
 15. The imagingmethod according to claim 12, further comprising, displaying andoutputting video outputted in the video processing.
 16. The imagingmethod according to claim 12, wherein the data related to the imagecapturing elements contain data related to fixed pattern noise of theimage capturing elements.
 17. The imaging method according to claim 12,wherein the data related to the image capturing elements contain datarelated to a plurality of image capturing elements.
 18. The imagingmethod according to claim 12, wherein part of the data related to theimage capturing elements is outputted by sampling processing.
 19. Theimaging method according to claim 18, wherein the sampling processing isperformed for every line of the image capturing elements.
 20. Theimaging method according to claim 18, wherein the sampling processing isperformed on every element of the image capturing elements.